Skip to content

Conversation

@zhen9910
Copy link

@zhen9910 zhen9910 commented Nov 18, 2025

As discussed in #8547, the existing wasi-nn onnx backend only uses the default CPU execution provider. This PR added onnx-cuda based wasi-nn GPU execution target in wasmtime-wasi-nn onnx backend.

@zhen9910 zhen9910 requested review from a team as code owners November 18, 2025 20:04
@zhen9910 zhen9910 requested review from fitzgen and removed request for a team November 18, 2025 20:04
@zhen9910 zhen9910 force-pushed the zkong/update-ort-and-onnx-gpu branch from 482de2b to 75caf05 Compare November 19, 2025 00:03
@devigned
Copy link
Contributor

Looks like the bump to ort caused cargo vet to be angry, which is to be expected.

+1 to the addition of GPU support for the ONNX backend \o/

@abrown, you might be interested in this one.

@fitzgen fitzgen requested review from abrown and removed request for fitzgen November 19, 2025 20:51
@zhen9910
Copy link
Author

@abrown could you please review the PR and add the cargo vet entries?

@alexcrichton
Copy link
Member

@abrown is in the process of handing off wasi-nn maintenance/work to @jlb6740 and @rahulchaphalkar so as a heads up this might take a moment @zhen9910 to allocate time to work on it.

@zhen9910
Copy link
Author

@abrown is in the process of handing off wasi-nn maintenance/work to @jlb6740 and @rahulchaphalkar so as a heads up this might take a moment @zhen9910 to allocate time to work on it.

I see, thanks for update

@zhen9910 zhen9910 force-pushed the zkong/update-ort-and-onnx-gpu branch from 75caf05 to c919981 Compare January 12, 2026 20:16
@zhen9910
Copy link
Author

@alexcrichton could you take a look this PR, which is rebased against main with cargo vet and ort changes

@alexcrichton
Copy link
Member

I unfortunately am not equipped myself to review/maintain wasi-nn. Historically that was Andrew, who's now handed off to @jlb6740 and @rahulchaphalkar, but they (I suspect) have other priorities to balance too. @zhen9910 if you'd like to reach out to them directly I'm sure they'd be happy to help work on a path forward

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants